Imaging system and imaging device

ABSTRACT

In one embodiment, an image capturing system is configured so that a device for capturing images is communicable with an external device through a communication unit. The image capturing system is provided with an operating unit configured to make settings pertaining to image capturing, an image capturing device serving as the device for capturing images and being configured to produce image data by periodically capturing images based on the settings made to the operating unit and a display unit configured to produce a display output based on the image data.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation of U.S. application Ser. No.15/053,536 filed Feb. 25, 2016, which is a continuation of InternationalApplication No. PCT/JP2014/071562, filed on Aug. 18, 2014 which is basedupon and claims the benefit of priority from Japanese Patent ApplicationNo. 2013-176756, filed Aug. 28, 2013. The contents of each areincorporation herein by reference in their entirety.

FIELD

Embodiments disclosed herein relate to an image capturing system and animage capturing device.

BACKGROUND

A refrigerator system using a camera has been proposed to obtaininformation of food stored inside the refrigerator.

Unlike the so-called security camera, the above described camerarequires user instructions every time an image of the fridge interior isto be captured in order to obtain information of the fridge interior.That is, a camera provided with an image capturing portion requirestroublesome operations such as acquiring image data by user operation ofthe operating portion.

BRIEF DESCRIPTIONS OF THE DRAWINGS

FIG. 1 is a schematic view of an image capturing system of oneembodiment.

FIG. 2A is a front view illustrating the external look of an imagecapturing device and FIG. 2B is a vertical cross-sectional viewillustrating an internal structure of the image capturing device.

FIG. 3 is schematically illustrates an electric configuration of theimage capturing device and the in-fridge image capturing system.

FIG. 4 is a flowchart of a main process.

FIG. 5 is a flowchart of a first image capturing process.

FIG. 6 is a flowchart of a second image capturing process.

DESCRIPTION

In one embodiment, an image capturing system is configured so that adevice for capturing images is communicable with an external devicethrough a communication unit. The image capturing system is providedwith an operating unit configured to make settings pertaining to imagecapturing, an image capturing device serving as the device for capturingimages and being configured to produce image data by periodicallycapturing images based on the settings made to the operating unit and adisplay unit configured to produce a display output based on the imagedata.

In one embodiment, an image capturing device is used in an imagecapturing system provided with a display unit configured to produce adisplay output based on image data and an operating unit configured tomake settings pertaining to image capturing. The image capturing deviceis provided with an image capturing portion configured to produce imagedata by periodically capturing images based on the settings made to theoperating unit; and a communication unit configured to communicate withan external device. The image data is transmittable to the externaldevice through the communication portion.

Embodiments disclosed herein provide an image capturing system and animage capturing device with improved usability to be suitable forpractical use.

A description will be given on one embodiment with reference to FIGS. 1to 6.

As illustrated in FIG. 1, an image capturing system 100 of the presentembodiment is configured by a refrigerator 1 being one example of a homeappliance, an image capturing device 2 for capturing an in-room image,an access point 3, and an external device such as a mobile terminal 4,etc. The access point 3 is connected to an external network 5 and isconfigured to communicate with the image capturing device 2, etc. Theaccess point 3 communicably interconnects the mobile terminal 4 and aserver 6, etc. located in remote locations with the image capturingdevice 2 side or the refrigerator 1 side by way of the external network5. In the present embodiment, a Bluetooth (registered trademark)wireless communication is exchanged between the image capturing device 2and the access point 3; between the access point 3 and the mobileterminal 4; and between the refrigerator 1 and the access point 3.

The mobile terminal 4 is provided with a display screen 4 a configuredto display image data captured by the image capturing device 2. Themobile terminal 4 serves as a communication terminal and examples of acommunication terminal envisaged in the present embodiment include theso-called smart phone (highly functional mobile phone). Examples of thecommunication terminals include, apart from the mobile terminal 4discussed herein, a tablet PC. When the mobile terminal 4 is locatedinside a residence 7, the mobile terminal 4 is communicably connected tothe access point 3 by a close-range wireless communication. When themobile terminal 4 is located outside the residence 7, the mobileterminal 4 is communicably connected to the access point 3 by awide-range wireless communication by way of external network 5. Themobile terminal 4 is further capable of connecting to the access point 3by way of the external network 5 through wide-range communication evenwhen located inside of the residence 7. The mobile terminal 4 locatedinside the residence 7 is further capable of communicating directly withthe camera device side 2 or the refrigerator 1 side without theintervention of the access point 3

The server 6 is configured by a computer system known in the art. Theserver 6 is provided with a storing unit configured to store image datacaptured by the image capturing device 2. The storing unit of the server6 includes nonvolatile memory such as a ROM, volatile memory such as aRAM, and electrically rewritable nonvolatile memory such as an EEPROM.The storing unit of the server 6 stores information (such as an IPaddress) for accessing the image capturing device 2. The mobile terminal4 and the server 6, etc. are provided with a display unit (only thedisplay screen 4 a of the mobile terminal 4 is illustrated in FIG. 1)configured to produce a display output based on the image data. Themobile terminal 4 and the server 6, etc. are examples of an externaldevice. The display unit may be provided at the image capturing device2.

By interconnecting the home appliances such as the refrigerator 1 over anetwork (see communication adaptor 34 of FIG. 3), it is possible to:visualize the electric power consumption of each home appliance for theuser's reference; shift the peak of electric power consumption duringthe day time in summer for example when there is a large demand forelectric power; perform various controls of electric power consumptionsuch as peak cutting in which a momentary use of electric powerexceeding the rated level in a general household is inhibited; performfailure diagnosis of home appliances, etc. The network of homeappliances provides a user friendly, convenient, and an easy to usesystem by offering functionalities such as those exemplified above.

The image capturing device 2 of the present embodiment is installed tothe refrigerator 1 by the user so that images of the status inside therefrigerator 1 (that is, the status of items stored in the fridge) canbe captured. Various information pertaining to each of the homeappliances and image data captured by the image capturing device 2, etc.is stored in the server 6 or transmitted to the mobile terminal 4. It isthus, possible to view such information through the mobile terminal 4,etc. over the external network 5 any time even from remote locations.

The refrigerator 1, being one example of a storage, is provided with arefrigeration chamber in its upper portion. The refrigeration chamber isopened/closed by left and right doors 1 a and 1 b taking a double doorconfiguration. For example, the image capturing device 2 is disposed inthe rear surface side (at the door pocket not illustrated in the innerside) of the right side door 1 b having the greater lateral dimensionamong the doors 1 a and 1 b (see the double-dot chain line illustratedin FIG. 1). The image capturing device 2 is to be further installed in aposition allowing easy look of the fridge interior such as at the rearsurface side of a drawer-type door 1 c in the vegetable chamber locatedbelow the refrigeration chamber.

The front surface of the doors 1 a to 1 c of the refrigerator 1 arecovered by a glass plate formed of an insulative glass allowingpermeation of radio waves. The interior of the doors 1 a to 1 c arepacked with a fill material such as urethane serving as a thermalinsulation material. The rear surfaces of doors 1 a to 1 c areconfigured by a nonmetallic resin plate. Thus, radio waves for wirelesscommunication outputted from the image capturing device 2 are allowed topermeate more easily compared to doors 1 a to 1 c formed of metal plate,or the like. Thus, especially in a double-door configuration as in thecase of doors 1 a and 1 b, it is possible to easily let out the radiowaves from the clearance between the doors 1 a and 1 b by disposing theimage capturing device 2 in the opening end side of the right-side door1 b as indicated by a double-dot chain line in FIG. 1 to be located inthe central portion in the later direction of the refrigeration chamber.According to the above described positioning of the image capturingdevice 2, radio waves are easily let out from the fridge even when thefront surfaces of the doors 1 a and 1 b are made of metal material, andthe possibility of the radio waves being blocked is small since theinteriors of the doors 1 a and 1 b are filled with urethane.

A vacuum thermal insulation material may be used instead of urethane orwith urethane to serve as a thermal insulation material of therefrigerator 1. The vacuum insulation material is formed into a thinrectangular plate for example by wrapping a core material with glassfiber, etc. with a film formed by adhering (laminating) a metal foil(aluminum foil for example) on a film made of synthetic resin forexample. When the vacuum thermal insulation material is used in theinside of the body and the doors of the refrigerator 1, it is possibleto facilitate propagation of the radio waves to the fridge exterior byavoiding the use of vacuum thermal material near the image capturingdevice 2. It is thus, possible to facilitate the propagation of radiowaves while maintaining the heat insulativity of the refrigerator 1 asmuch as possible and allow information from the image capturing device 2to be transmitted to external devices without the intervention of thecommunication adaptor 34 of the refrigerator 1.

Next, a description is given on the image capturing device 2.

The image capturing device 2 has a body 10 serving as an outer shellshaped like a cuboid as illustrated in FIG. 2A. The image capturingdevice 2 comprises a camera provided with a lighting unit allowingimages to be captured in a dark room such as the interior of therefrigerator 1. An image capturing lens 12, an image capturing lighting13, and a light sensor 14 a are provided on the body 10 in an exposedmanner. A description is given hereinafter with an assumption that theexposed side of the body 10 where the lens 12, etc. are exposed (theright side in FIG. 2B) is the main surface 10 a of the image capturingdevice 2 and the opposite side is the rear surface. The lens 12 and thelight 13 may be hidden under a cover, etc. instead of being exposedoutside the body 10.

As illustrated in FIG. 2B, a control substrate 15, a battery 16, and acommunication module 17 are stored inside the body 10. For example, acouple of lights 13 comprising an LED and the lens 12 are implemented onthe control substrate 15. The couple of lights 13 are disposed in twoopposing sides of the lens 12. The direction of irradiation of thelights 13 is oriented in the direction of image capturing of the imagecapturing device 2 so that the interior of the dark room is illuminatedby the light irradiated when image is captured. The lights 13 and theoptical sensor 14 a serve as the lighting unit. An image capturingportion 11 (illustrated in FIG. 3), configured by elements such as CCDand CMOS known in the art, and image capturing side controller 18 areprovided on the control substrate 15.

The battery 16 supplies electric power to a detecting portion 14, imagecapturing side controller 18, and the communication module 17, etc. Theimage capturing device 2 is driven by the battery 16 installed therein.The image capturing device 2 is capable of running without power plugcable, etc. and thus, may be installed in any location. In the presentembodiment, the image capturing device 2 may be installed inside astorage such as the refrigeration 1 of the present embodiment providedwith a door.

The communication module 17 is configured to transmit image data of thefridge interior captured by the image capturing portion 11 to externaldevices and also serves as a communication portion for receiving timeinformation later described. The image data is transmitted to the mobileterminal 4, the server 6, etc. by way of the access point 3. The server6 stores the transmitted image data. The image data is data containingcaptured images of the fridge interior. Examples of image data includedata (still image, moving image) of known formats such as a bit mapformat and JPEG/MPEG format and compressed/encrypted forms of such dataas well as converted forms of such data converted by image processing.The image data may come in any format as long as the interior of astorage can be viewed through the mobile terminal 4 or the like.

An operating portion 20 (see FIG. 3) configured by various switches areprovided on a side portion of the body 10. The various switches providedin the operating portion 20 include various switches pertaining to imagecapturing such as a power switch 20 a, a mode switch 20 b, and, a setswitch 20 c. More specifically, the power switch 20 a is an operatingportion configured to turn ON/OFF the power of the image capturingdevice 2. Mode switch 20 b serves as a mode setting unit. It is possibleto select either of a time setting mode, a first image capturing mode,and a second image capturing mode by operating the mode switch 20 b.

The time setting mode sets the time of an RTC 18 d (see FIG. 3) of aninternal clock. The image capturing side controller 18 executesoperations and controls at the time designated by the image capturingdevice 2, keeps track of time, etc. by referring to the time indicatedby the RTC 18 d. The image capturing device 2 is capable ofcommunicating with the external network 5 through the communicationmodule 17. In the time setting mode, the image capturing device 2 setsthe time of the RTC 18 d using the time acquired by a time server (asever capable of transmitting time information) not illustrated which isindependent of the server 6.

The first image capturing mode captures images periodically with aprescribed periodicity. The image capturing side controller 18 performsimage capturing automatically under the first imaging capturing mode atthe designated time (such as 3 o'clock in the afternoon) at preciseperiod (24 hour period for example) by referring to the time tracked byRTC 18 d. Thus, by placing the image capturing device 2 inside therefrigerator 1 and making a setting to the first image capturing mode,it is possible for the user to view the latest image data taken by theimage capturing device 2 at the installed location. For example, it ispossible to view the types of food inside the fridge through the mobileterminal 4, etc. The designated time may be preset by default or may bespecified by the user through the operating portion 20.

In the second image capturing mode, image capturing is performed after aprescribed time has elapsed from the operation of the set switch 20 c.The prescribed time indicates a certain time period (10 seconds forexample) given from the installation of the image capturing device 2 toan execution of automatic image capturing. Thus, in the second imagecapturing mode, it is possible to execute automatic image capturing withthe door 1 b closed after elapse of 10 seconds from the operation of theset switch 20 c when the image capturing device 2 has been set to thedoor pocket of the door 1 b of the refrigerator 1. In the second imagecapturing mode, it is possible to learn the suitability of the locationwhere the image capturing device 2 is installed by viewing the imagecaptured with the door 1 b closed through the mobile terminal 4, etc.The second image capturing mode is a test shot (for locationingpurposes) mode, so to speak, of the image capturing device 2.

The set switch 20 c serves, for example, as a determining key fordetermining the execution of the mode selected by the mode selectionswitch 20 b or for starting the execution of the selected mode. Theseswitches 20 a to 20 c are not limited to the above described types orthe above described methods of operation. For example, the mode switch20 b may be configured as a sliding switch which is slid to determinethe selection of various modes. The number of selectable modes may beincreased or decreased from the selections described above.

The image capturing side controller 18 of the present embodiment isconfigured to append identification data to the captured images todistinguish the mode in which the images were captured. For example, anidentification data indicating that the image has been captured in thesecond image capturing mode is appended to image data captured in thesecond image capturing mode. The image capturing side controller 18 maybe configured to distinguish the image data of the two modes byappending the identification data to either or both of the image datacaptured in the first image capturing mode and the second imagecapturing mode.

The image capturing side controller 18 is configured primarily by amicrocomputer and is responsible for the overall control of the imagecapturing device 2. As illustrated in FIG. 3, the image capturing sidecontroller 18 includes components such as a CPU 18 a, ROM 18 b, RAM 18c, RTC 18 d, etc. The image capturing side controller 18 is configuredto execute controls to prepare the environment for image capturing suchas a controlling the timing of image capturing carried out by the imagecapturing portion 11 and controlling the timing in which the imagecapturing light 13 is illuminated. The image capturing side controller18 also serves as a control unit configured to execute controls fortransmitting image data through the communication module 17 and forperforming image processing such as modifying the captured images. TheROM 18 b stores a control program for executing processes in multiplemodes.

The image capturing side controller 18 is connected to the imagecapturing portion 11, the lights 13, the operating portion 20, thecommunication module 17, and the detecting portion 14. The detectingportion 14 includes the optical sensor 14 a and a sound sensor 14 b forexample. The optical sensor 14 a is an illuminance sensor configured todetect the illuminance around the image capturing device 2 and detectsoptical energy of a prescribed wavelength band. The optical energydetected by the optical sensor 14 a is converted into electric signaland outputted to the image capturing side controller 18. The soundsensor 14 b is configured to detect sound energy produced in theprescribed frequency band, which is produced in the present embodimentby a panel buzzer 29 or in-fridge buzzer 33 described herein. The soundenergy detected by the sound sensor 14 b is converted into electricsignal and outputted to the image capturing side controller 18.

As later described in detail, the image capturing device 2 normallystands-by in a low power mode consuming relatively less electric powercompared to the normal operation mode and returns to the normaloperation mode when executing image capturing in the first imagecapturing mode or the second image capturing mode. The captured imagesdata is transmitted to external devices through the communication module17 by unidirectional communication. When the system time needs to beset, in other words, when in the time setting mode, time is acquired orreceived in the normal mode in response to request from thecommunication module 17 side by bidirectional communication. In thepresent embodiment, it is possible to perform unidirectionalcommunication in which communication is directed one way toward theexternal devices and a bidirectional communication in which datacommunication is exchanged bidirectionally between the image capturingdevice 2 and the external devices through radio waves. There is no needto perform both outgoing and incoming communications in a unidirectionalcommunication. There are less occasions to perform bidirectionalcommunication under the time setting mode compared to the frequency ofimage capturing. Thus, unidirectional communication is preferred overbidirectional communication in terms of power consumption.

The fridge-side controller 21 of the refrigerator 1 illustrated in FIG.3 is configured primarily by a microcomputer and is responsible for theoverall control of the refrigerator 1. The fridge-side controller 21includes a CPU 21 a, a ROM 21 b, a RAM 21 c, a timer 21 d, etc. Thefridge-side controller 21 is connected to the refrigeration coolingmechanism 25 and the freeze cooling mechanism 26 configured by a knownrefrigeration cycle, etc. The fridge-side controller 21 is furtherconnected to a door sensor 24 of the refrigerator 1, a later describedcontrol panel 22, and the temperature sensor 23. The fridge-sidecontroller 21 is configured to control the drive of the coolingmechanisms 25 and 26 based on the in-fridge temperature detected by thetemperature sensor 23 and the opened/closed status of the door detectedby the door sensor 24 so that operational status set by the controlpanel 22 can be achieved.

The control panel 22 is provided with a panel display and a panel LEDneither of which are illustrated, and a panel buzzer 29. The paneldisplay and the panel LED display the specified settings and illuminatethe operable switches. The panel buzzer 29 is configured by apiezoelectric buzzer for example and notifies the type of operationsmade by producing a sound (sound energy) depending upon the operationsmade. In the present embodiment, the panel buzzer 29 is capable ofoutputting a sound of 6 kHz. The panel buzzer 29 also serves as atransmitting unit configured to produce sound energy in order totransmit information pertaining to image capturing to the imagecapturing device 2 through a prescribed ringing pattern.

The in-room buzzer 33 illustrated in FIG. 3 comprises a piezoelectricbuzzer provided for example in a refrigeration chamber. The in-roombuzzer 33 is configured to produce sound energy and serves as atransmitting unit. The in-room buzzer 33 is capable of outputting soundof 20 kHz for example beyond the audible range and is detectable by thesound sensor 14 b. A blower 31 is provided for circulating cool airinside the refrigerator 1 when operated normally. The blower 31 iscapable of producing sound energy such as wind noise and motor sound byincreasing the rotation count to be greater than the rotation countobserved during normal operation. The buzzers 29 and 33 as well asblower 31 may be selectively configured to serve as a transmitting unit.

An in-room lighting 30 and an in-room LED 32 are both provided, forexample, inside the refrigeration chamber, etc. The in-room lighting 30is configured to produce optical energy by illuminating when the door isopened. The in-room lighting 30 is configured to be capable offlickering under the control of the fridge-side controller 21. Thein-room LED 32 is configured to produce light (optical energy) belongingto a prescribed frequency band capable of being detected by the opticalsensor 14 a in order to transmit information to the image capturingdevice 2. The in-room LED 32 is capable of flickering in a certainpattern to indicate information pertaining to image capturing. Thein-room lighting 30 and the in-room LED 32 both serve as a transmittingunit configured to transmit information pertaining to image capturing tothe image capturing device 2 through optical energy. It is thus,possible to use the in-room lighting 30 and the in-room LED 32selectively.

The communication adaptor 34 is provided detachably to the refrigerator1. The communication adaptor 34 is configured to exchange communicationwith the access point 3 and with the mobile terminal 4, etc. located inthe room. The communication adaptor 34 is further configured to becapable of communicating directly with the image capturing device 2without the intervention of the access point 3. The communicationadaptor 34 is also used for visualization of system status, etc. asdescribed earlier and thus, is basically operative while therefrigerator 1 is in service. Though only the refrigerator 1 isillustrated in FIG. 1, the communication adaptor 34 is also provided toother home appliances such as an air conditioner to establish a networkof home appliances.

A communication unit undertaking the communication between, for example,the mobile terminal 4 and the image capturing device 2 is configured bythe communication module 17, the communication adaptor 34, the accesspoint 3, and the external network 5, etc. The communication between themobile terminal 4 and the image capturing device 2 may be exchangeddirectly through radio waves without the intervention of thecommunication adaptor 34 of the refrigerator 1 or indirectly through theintervention of the communication adaptor 34. In case of the latter,information may be transmitted to the image capturing device 2 throughthe transmitting unit to exchange information between the imagecapturing device 2 (controller 18) and the refrigerator 1 (controller21). That is, information pertaining to image capturing is conveyed by,for example, causing the flickering and the ringing in a pattern whichwill not occur when the refrigerator 1 is under normal use. It ispossible for the image capturing side controller 18 to identify theinformation pertaining to image capturing conveyed by the flickeringpattern or the ringing pattern by referring to a prescribed data table.A description is given herein with an assumption that directcommunication is exchanged between the mobile terminal 4 and the imagecapturing device 2, meaning that the communication adaptor 34 of therefrigerator 1 can be omitted.

The operation of the above described configuration is given herein.

The user is to place the image capturing device 2 at the desiredlocation inside the room of the residence 7. Since the image capturingdevice 2 is provided with an image capturing light 13, it is possible toplace it in a dark room such as the interior of the refrigerator 1. Thefollowing description is based upon an assumption that the imagecapturing device 2 is installed at the door pocket of the right-sidedoor 1 b of the refrigerator 1 as indicated by the broken line in FIG. 1so that the main surface 10 a of the image capturing device 2 isoriented toward the back of the refrigeration chamber interior with thedoor 1 b closed when capturing the image of the fridge interior. Theflowcharts provided in FIGS. 4 to 6 indicate the control programsexecuted by the image capturing side controller 18 and are started whenthe power switch 20 a of the image capturing device 2 is turned ON.

When power of the image capturing device 2 is turned ON by the powerswitch 20 a (step S1 of FIG. 4), the image capturing device 2 iscontrolled to the sleep mode (step S2). The sleep mode corresponds tolow power mode which consumes less electric power compared to the normaloperation mode. When communication module 17 is constantly operative ina system configuration capable of bidirectional communication, powerconsumption will increase and require battery 16 replacement or chargingin one or few days. Thus, the image capturing side controller 18 isconfigured, while in the sleep mode, to judge the presence/absence ofsettings made in the operating portion 20.

The bidirectional communication of the image capturing device 2 isexecuted when the time setting mode is specified (step S3: YES, step S4)by the user operation of the mode switch 20 b. Though not illustrated,the image capturing side controller 18 returns to the normal operationmode and receives time information from the time server through theexternal network 5 in response to a request signal given from thecommunication module 17 side. It is thus, possible to correct the RTC 18d with the acquired time information even when the time indicated by theRTC 18 d is incorrect. When the time setting process is completed atstep S4, the control returns to the sleep mode (returned to the stepS2). It is thus, possible to reduce power consumption as much aspossible.

When it is desired to take a test shot immediately after installing theimage capturing device 2 to the door pocket (the fridge interior), themode switch 20 b is operated to select the second image capturing modewhich corresponds to a test shot mode (step S3: NO, step S5: NO, andstep S7: YES). In such case, the image capturing side controller 18proceeds to step S8 to execute the second image capturing process (seeFIG. 6). In the second image capturing process, the image capturing sidecontroller 18 returns to the normal operation mode (step S21) and judgeswhether or not a prescribed time has elapsed (step S22) after the setswitch 20 c has been operated. As described earlier, the prescribed timeis a time period (10 seconds for example) given from the installation ofthe image capturing device 2 to an execution of automatic imagecapturing. The automatic image capturing is executed by the imagecapturing device 2 with the door 1 b closed after the installation ofthe image capturing device 2 (step S23). When the image capturing sidecontroller 18 makes a judgement that illuminance inside the fridge doesnot meet a prescribed illuminance based on the detection signal given bythe optical sensor 14 a, the image capturing side controller 18 lightsthe fridge interior. Then, the image capturing side controller 18transmits the captured image data along with identification dataindicating that the image data was taken as a test shot to the mobileterminal 4 or stores the same to the server 6 (step S24). Aftercompleting the second image capturing process, the process returns tothe sleep mode (return to step S2).

When the user desires to perform image capturing on a periodic basis atthe current location of the image capturing device 2 as the result ofthe test shot, the mode switch 20 b is operated to select the firstimage capturing mode (step S5: YES). Then, the image capturing sidecontroller 18 proceeds to step S6 to execute the first image capturingprocess (see FIG. 5). In the first image capturing process, the imagecapturing side controller 18 stands by in a sleep mode until thedesignated time arrives (step S11: YES) to execute a periodic imagecapturing with a prescribed periodicity. Then, the image capturing sidecontroller 18 returns to the normal operation mode (step S12) on arrivalof the designated time and captures an image of the fridge interior(step S13). The image capturing side controller 18 captures image of thefridge interior with lighting as was the case in the second imagecapturing process and transmits the captured image data to the mobileterminal 4 and/or the server 6 (step S14). Then, the image capturingside controller 18 returns to the sleep mode again (step S16). The imagecapturing side controller 18 executes periodic image capturing byrepeating step S14 to S16 until a switch is made to other modes (stepS15: NO).

When installing the image capturing device 2 or when receiving imagedata captured periodically, it is possible to display images of foodstored in the fridge on the screen 4 a of the mobile terminal 4 based onthe received data. The mobile terminal 4 is capable of distinguishingthe images captured in the second image capturing mode based on theidentification data. For example, a notation that may read “taken on ∘∘day” may be displayed on the screen 4 a with the image captured in thefirst image capturing mode. Similarly, a notation that may read “testshot” may be displayed on the screen 4 a with the image captured in thesecond image capturing mode.

As described above, the image capturing system 100 of the presentembodiment is configured so that a device for capturing images iscommunicable with external devices through a communication unit. Thesystem is provided with an operating portion 20 configured to makesettings pertaining to image capturing, an image capturing device 2serving as the device for capturing images and being configured toproduce image data by periodically capturing images based on thesettings made to the operating portion 20, and a display unit configuredto produce a display output based on the image data.

Accordingly, the image capturing device 2 is configured to becommunicable with external devices and a display output can be producedbased on the image data captured by the image capturing device 2. It isthus, possible to view the images, periodically captured based on thesettings made to the operating portion 20, through the display unit.This improves usability of the system and makes the system more suitablefor practical use.

The operating unit for making settings pertaining to image capturing isnot limited to the operating portion 20 of the image capturing device 2but may be configured by an operating portion provided on an externaldevice. For example, a touch panel of the mobile terminal 4 or akeyboard of the server 6 (neither illustrated) may serve as theoperating unit which makes settings pertaining to image capturing to theimage capturing device 2 through the communication unit. Suchconfiguration provides effects similar to those described above.

The display unit is provided at the external device and the image dataproduced by the image capturing device 2 is transmitted to the externaldevice through the communication unit. As a result, it is possible toview the images captured by the image capturing device 2 through thedisplay unit of the external device located remotely from the imagecapturing device 2.

The image capturing device 2 is disposed at a storage provided with adoor and is configured to be capable of capturing images of an interiorof the storage. The image capturing device 2 is further configured tocapture test images of the interior of the storage when a prescribedtime period has elapsed after the settings have been made to theoperating portion 20. Accordingly, it is possible to take test shotsafter securing enough time required for closing the door after imagecapturing device 2 is installed at the storage. It is possible to viewthe image taken by the image capturing device 2 immediately afterinstalling the image capturing device 2 to the storage by setting theprescribed time as described above. This improves the usability of thesystem even more effectively. It is required to take test shots of theinterior of the storage (room) after the door is shut especially whenthe image capturing device 2 is mounted on the door. Thus, it iseffective to set the prescribed time.

The image capturing device 2 is disposed in a dark room. A lighting unitis provided at least at the image capturing device 2 or in the darkroom. When capturing images, the image capturing device is configured tolight the dark room by the lighting unit. Accordingly, it is possible toobtain an image of the interior of the dark room (an image of food inthe storage in the embodiments) even when the illuminance of the darkroom does not meet a prescribed level.

The image capturing device 2 is configured to transmit the image data tothe external device through unidirectional communication. Accordingly,it is not required to keep the communication module 17 constantlyoperative for the possibility of receiving information throughbidirectional communication. It is thus, possible to reduce powerconsumption. Bidirectional communication is performed in the presentembodiment when mode switching is made. Unidirectional communication mayindicate a communication mode in which the transmitting side and thereceiving side are fixed and not interchangeable.

The image capturing device 2 is battery driven and is configured tonormally standby in a low power mode consuming relatively less electricpower compared to a normal operation mode. The image capturing device 2is configured to return to the normal operation mode when capturingimages. Accordingly, it is possible to reduce electricity consumptionwhile in standby since the image capturing device 2 does not have tostandby in the normally operating state.

The external device comprises a server 6 provided with a storing unitconfigured to store image data acquired through the communication unit.Accordingly, it is possible to accumulate image data acquiredperiodically to the storing unit of the server 6 while allowing imagedata to be retrieved from the server 6 through other external devices.

The external device comprises a communication terminal provided with aterminal side display unit configured to display images based on imagedata acquired through the communication unit. Accordingly, it ispossible to view the image displayed on the display unit (screen 4 a forexample) of the communication terminal and thereby improve userfriendliness.

The display unit is configured to display an image originating fromimage data captured with a prescribed periodicity and an imageoriginating from image data produced by a test shot taken when aprescribed period has elapsed after the settings have been made to theoperating portion 20 in a distinguished manner. Accordingly, it ispossible to distinguish the two images even when the former and thelatter image data may both be displayed through the displaying unit. Itis thus, possible to identify the test shot image with ease.

The image capturing device 2 is configured to distinguish image datacaptured with a prescribed periodicity and image data produced by a testshot taken when a prescribed period has elapsed after the settings havebeen made to the operating portion 20 by appending identification datato at least either of the image data when transmitting each type ofimage data to the external device. Accordingly, it is possible todistinguish each of the images when viewing them through the externaldevice by providing an identification to each of the image data capturedperiodically and the image data taken by test shots.

The image capturing device 2 is configured to be capable of selectingeither a first image capturing mode in which images are capturedrepeatedly according to prescribed conditions or a second imagecapturing mode in which images are captured when predetermined periodhas elapsed after the settings have been made to the operating portion20. Accordingly, it is possible to select image capturing to be carriedout by the image capturing device 2 under either of the first imagecapturing mode or the second image capturing mode depending upon theuser's objectives and thereby improving usability of the system.

The prescribed conditions for determining the timing of image capturingunder the first image capturing mode may be a timing in which the amountof food storage has changed, or a timing in which the amount of foodstorage is presumed to have changed. For example, a weight sensor may beprovided to the refrigerator 1 to detect the weight of food placed inthe container or on the shelves (neither illustrated) of the fridgeinterior. The timing in which the weight detected by the weight sensorhas changed may be detected by the fridge side controller 21 andautomatic image capturing may be executed at the detected timing. It isthus, possible to eliminate wasteful image capturing (communicationlosses) by only allowing images to be captured when the storage amountof food has changed.

The detecting unit for detecting the amount of food storage may comprisean infrared sensor or an image recognizing unit. The change in the foodstorage status may be detected by the fridge-side controller 21 based onthe signals given by the sensor and based on the image data. A lightdetecting unit configured to detect amount of light in the fridge or adoor sensor 24 may be used to make a presumption by the fridge sidecontroller 21 that the food inside the fridge has been consumed or thatfood has been added based on the detection of opening of the door.

In some embodiments described above, the image capturing device 2 wasinstalled inside the refrigerator 1. However, the image capturing device2 may be installed in a room of a residence 7, other types of storages,or a dark room.

The image capturing device 2 need not be detachably attached to therefrigerator 1 but may be provided to be structurally integral with therefrigerator 1 so as to be capable of capturing images of the fridgeinterior. The image capturing side controller 18 may be provided insidethe fridge side controller 21. In such case, the communication adaptor34 may be configured to also function as a communication module 17. Whenthe image capturing device (camera) is provided structurally integralwith the storage, though not illustrated, the test shot featuresdescribed above becomes effective when the image capturing portion orthe image capturing light disposed on the wall or the door of the fridgeinterior is capable of changing its orientation or is capable of beingrelocated by establishing a cable connection with the controller.

While certain embodiments have been described, these embodiments havebeen presented by way of example only, and are not intended to limit thescope of the inventions. Indeed, the novel embodiments described hereinmay be embodied in a variety of other forms; furthermore, variousomissions, substitutions and changes in the form of the embodimentsdescribed herein may be made without departing from the spirit of theinventions. The accompanying claims and their equivalents are intendedto cover such forms or modifications as would fall within the scope andspirit of the inventions.

What is claimed is:
 1. An image capturing system configured so that animage capturing device is communicable with an external device through acommunication portion, the image capturing device comprising: a bodyserving as an outer shell of the image capturing device; an operatingportion provided on the body and being configured to make settingspertaining to image capturing by a user operation, an image capturingportion configured to produce image data by capturing images and beingprovided inside the body; and a communication portion provided insidethe body and is configured to transmit the image data captured by theimage capturing portion to the external device, wherein the imagecapturing device is disposed inside a storage provided with a door at alocation at which a condition of an interior of the storage can beeasily identified and comprises a lighting unit provided in the storageas a dark room or at the image capturing device, wherein when capturingimages, the image capturing device is configured to light the dark roomby the lighting unit, wherein the external device is located outside thestorage as a device independent of the image capturing device andcomprises a display unit configured to produce a display output based onthe image data, wherein the image capturing device is configured to becapable of capturing images based on the settings made through theoperating portion to capture images inside the storage and capturingimages in a first image capturing mode in which images are capturedrepeatedly with prescribed periodicity on a daily basis, wherein theimage capturing device is configured to take a test shot for imaging theinterior of the storage, when a prescribed time period has elapsed afterthe settings have been made by the operating portion, the test shotbeing captured based on the settings made, wherein the image capturingdevice is configured to transmit the image data captured based on thesettings made or captured under the first image capturing mode to theexternal device through a unidirectional communication performed throughthe communication portion, and wherein the image capturing device isbattery driven and is configured to normally standby in a low power modeconsuming relatively less electric power compared to a normal operationmode, the image capturing device being configured to return to thenormal operation mode when capturing images.
 2. The image capturingsystem according to claim 1, wherein the external device comprises aserver provided with a storing unit configured to store the image dataacquired through the communication portion.
 3. The image capturingsystem according to claim 1, wherein the external device comprises acommunication terminal provided with a terminal side display unitconfigured to display images based on the image data acquired throughthe communication portion.
 4. The image capturing system according toclaim 1, comprising an operating portion provided on the body and isconfigured to make settings pertaining to image capturing by a useroperation, wherein the display unit is configured to distinguish anddisplay an image originating from the image data captured regularly witha prescribed periodicity and an image originating from image dataproduced by a test shot taken when a prescribed period has elapsed afterthe settings have been made by the operating portion.
 5. The imagecapturing system according to claim 1, comprising an operating portionprovided on the body and is configured to make settings pertaining toimage capturing by a user operation, wherein, to distinguish the imagedata captured regularly with a prescribed periodicity and image dataproduced by a test shot taken when a prescribed period has elapsed afterthe settings have been made by the operating portion, the imagecapturing device is configured to append identification data to at leastone of the image data and transmit the image data to the externaldevice.
 6. The image capturing system according to claim 1, comprisingan operating portion provided on the body and is configured to makesettings pertaining to image capturing by a user operation, wherein theimage capturing device is configured to be capable of selecting eitherthe first image capturing mode or a second image capturing mode in whichan image is captured when a predetermined period has elapsed after thesettings have been made by the operating portion.
 7. An image capturingdevice for use in an image capturing system provided with a display unitconfigured to produce a display output based on image data, the imagecapturing device comprising: a body serving as an outer shell of theimage capturing device; an operating portion provided on the body andbeing configured to make settings pertaining to image capturing by auser operation, an image capturing portion configured to produce theimage data by capturing images and being provided inside the body; and acommunication portion provided inside the body and is configured totransmit the image data captured by the image capturing portion to theexternal device, wherein the image capturing device is disposed inside astorage provided with a door at a location at which a condition of aninterior of the storage can be easily identified and comprises alighting unit provided in the storage as a dark room or at the imagecapturing device, wherein when capturing images, the image capturingdevice is configured to light the dark room by the lighting unit,wherein the external device is located outside the storage as a deviceindependent of the image capturing device and comprises a display unit,wherein the image capturing device is configured to be capable ofcapturing images based on the settings made through the operatingportion to capture images inside the storage and capturing images in afirst image capturing mode in which images are captured repeatedly withprescribed periodicity on a daily basis, wherein the image capturingdevice is configured to take a test shot for imaging the interior of thestorage, when a prescribed time period has elapsed after the settingshave been made by the operating portion, the test shot being capturedbased on the settings made, wherein the image capturing device isconfigured to transmit the image data captured based on the settingsmade or captured under the first image capturing mode to the externaldevice through a unidirectional communication performed through thecommunication portion, and wherein the image capturing device is batterydriven and is configured to normally standby in a low power modeconsuming relatively less electric power compared to a normal operationmode, the image capturing device being configured to return to thenormal operation mode when capturing images.
 8. A storage comprising animage capturing device configured to be communicable with an externaldevice through a communication portion, the image capturing devicecomprising: a body serving as an outer shell of the image capturingdevice; an operating portion provided on the body and being configuredto make settings pertaining to image capturing by a user operation, animage capturing portion configured to produce image data by capturingimages and being provided inside the body; and a communication portionprovided inside the body and is configured to transmit the image datacaptured by the image capturing portion to the external device, whereinthe image capturing device is disposed inside a storage provided with adoor at a location at which a condition of an interior of the storagecan be easily identified and comprises a lighting unit provided in thestorage as a dark room or at the image capturing device, wherein whencapturing images, the image capturing device is configured to light thedark room by the lighting unit, wherein the external device is locatedoutside the storage as a device independent of the image capturingdevice and comprises a display unit configured to produce a displayoutput based on the image data, wherein the image capturing device isconfigured to be capable of capturing images based on the settings madethrough the operating portion to capture images inside the storage andcapturing images in a first image capturing mode in which images arecaptured repeatedly with prescribed periodicity on a daily basis,wherein the image capturing device is configured to take a test shot forimaging the interior of the storage, when a prescribed time period haselapsed after the settings have been made by the operating portion, thetest shot being captured based on the settings made, wherein the imagecapturing device is configured to transmit the image data captured basedon the settings made or captured under the first image capturing mode tothe external device through a unidirectional communication performedthrough the communication portion, and wherein the image capturingdevice is battery driven and is configured to normally standby in a lowpower mode consuming relatively less electric power compared to a normaloperation mode, the image capturing device being configured to return tothe normal operation mode when capturing images.